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WITHIN-VARIABLE, BETWEEN-OCCASION ERROR COVARIANCES 
IN MODELS OF EDUCATIONAL ACHIEVEMENT 

; ' , ABSTRACT * . 

To correct for the effects of measurement error on structural 
parameter estimates, many researchers are now estimating models of 

educational achievement with LISREL. In order to estimate such models 

■ / 

/ . ■ * , ■ ■ 

it \$: desirable to obtain multiple manifest measures of the latent* 

constructs. Many researchers restrict their models to two manifest, 

measure^ per latent construct for reasons of economy; but doing, so 

assumes in the absence of external information that all of the covariance 

between the within-variable measures is reliable covariarice. Such an 

assumption may or may not hold in practice. The present study 

empirically investigates the extent of within-variable, between-occasion 

error covariances among variables typically .included in models of 

.educational achievement using data from High School and Beyond. 




WITHIN-VARIABLE, BETWEEN-OCCASION^ER«Wg^H^R(ANCES 
IN MODELS OF EDUCATIONAL ACHII 

4 " * 

/ 

In the presence of random measurement error in tHifi^gressors, 
< . ' v • 

ordinary least-squarfes (OLS) estimates are biased, d^wnw^rd in bivariate 

regressions- and often biased in multivariate regressions ^Malker and Lev, 

1953). The usual response has been 'to assume the effeBp^f 

measurement error are probably minor* and consequently to , report 

( . ■ ■ 

uncorrected OLS estimates. Others haVe been less sanguine. Bowles 
(1972) and Bowles and Gintis (1976), among others, have argued that in 
models of socioeconomic achievement the* biases due to measurement error 

x iri background variables are serious, and suggested that social class 

/ - . 

background is -considerably more important than indicated by uncorrected 
OLS estimates. ' * * ; 

e 

r ,m 

Reteent methodological advances (Joreskog,^1966, 1967, 1969; 
Joreskog and Sorbom, 1981) permit the- empirical estimation of the 
measurement properties of manifest variables, and allow the estimation of 
structural parameter estimates corrected for measurement error. Initial 
applications (e.g., Bielby, Hauser/ and Fealherman, 1977) of thfe rtew 
procedure (LISREL)'to the analysis of njodels of socioeconomic 
achievement indicated that the biasing effects of measurement error 
among social background variables were neither pervasive nor very 6 
large. - # % 

In brief, the strategy followed by Bielby, et al. (1977), and 
several other applications that followed (e.g., Bielby and Hauser, 1977; 
Corcoran, 1980; Hauser, Tsai, and Sewell, 1983; Mare and Mason, 1980; 



Wolfle, 1983) has been either to measure retrospective reports of parental 
status at tvyp points in time or to use multiple respondents, and to use 
the consjstency of such reports as indicators of their reliabilities. This 
approach generally shows that, parental status reported with 
reliabilities ranging from .75 to .90.^ 

Several people (Bcoom, et all/ 1978; Heyns, 1978; Jencks, et.al., 
1979), however, have pointed out that multiple manifest responses may 
be consistent yet-inaccurate. Conventional methods of measuring 
reliability cannot detect errors of this type. The problem develops- from 
the riecessary practice of specifying that the error covariance of within- 
variable manifest variables, is fixed, usually at zero. To do otherwise 
would specify an underidentified model, which would have no unique 
solution. The consequence, however, is that all of the covariance 
between the within-variable measures is estimated to be reliable 
covariance. Such a specification is_ unwarranted if response errors are 
consistent over time. Respondents who overestimate or underestimate a 
socioeconomic measure on one occasion may repeat their mistake on 
another occasion. With only two manifest measures, however, these 
correlated response errors are included in the estimate of rejiable 
covariance, % and hence tend to overestimate^ the reliability of social 
background variables. 

The typical response to the possible presence of within-variable, 
between-occasion correlated response errors has been to ignore the 
problem, no doubt in the hope that the consequences were minor and 
insignificant, Some authors, however, ^ have tried to circumvent the 



identification problem .by using external information to fix error" f 
coyariances to some specified value other than zero. fi For example/" 
Bielby, et al. (1977) fixed the within-variable, befween-occasion error 
correlations' among* their socioeconomic variables-.to*. the arbitrary value of 
.5; in a more, recentfapplication, Hauser, et'al. X1983) estimated error, 
correlations in one sample, then used those estimates to fix .the withfti- 
variable error correlations for rep6rts of father's education" and mother's 
education at . 1^>n> their analyzed sample. * ' 

* The present study empirically investigates the extent v of within- 
variable, betweeri-occasion error covaVianjces "in models of educational 
achievement. The data used fqrJlhjs llWestigation were takien from "High 
School and Beyond" (HSB), a' longitudihaflstudy of U.S", high school 
sophomores and seniors, sponsored by the National Center for Education 

Statistics. 1 In particular, these analyses were based on a sample of 3367 

'i 

'HSB parents matched to their sophomore high school children. In the 
1980 base-year survey, both children and # a subsample of parents were - 
asked to report the educational attainment of the motherland father, and 
the father's occupation. -In 1982, the children were surveyed again, and 
againasked to report "on their parents' socioeconomic statuses. The 
analysis reported here is restricted to 1064 white- respondents who 
possessed bomplete reports for the nine variables included in the 
measurement model. r ^ 

MEASUREMENT MODEL 
The basic measurement model can be describ^J by a set of nine 
equations. The first three equations consider. the parent's report and 



both of the student's reports of the father's occupation to be dependent 
upon the father's true occupational status* The next three equations, 
consider the parent's report and both of the student's reports of the 
father's education to be dependent upon thfe father's true educational 
attainment. The final three quations do the same for mother s education. 
The three true* scores were allowed to covary without constraint. 
Covariances among the response errors were initially set .at zero on the 
assumption that response errors were random, thus providing a base-line 
model against which to test subsequent alterations to the m'odel. The 
model was then modified to permit the estimation of within-variable/ 
between-occasion error covariances; this was accomplished by allowing 

the err6rs of the student's reports in the base-year survey to covary- 

p" . f 

with their reports in the first follow-up survey for each of the three 
parental status variables. 

. When all three parental status characteristics are considered' 
simu Itarj eously another possible- source of error covariance must be 

appraised. One may suspect that respondents who overestimate or 

i , • 

underestimate one parental status measure are also Ijkely to do. the same 
in subsequent reports. ' One may also suspect that students who are 
unsure about one parent's education may reconcile their uncertainty by 
substituting known information about one parent for unknown information 
about the other (see, e.g., Wolfle -and Robertshaw, 1983). In the . 
present analysis, these between-variable, within-occasion error 
covariances- were allowed to" be free after first estimating the within- 
variable, between-occasion error covariances. 



The resulting, measurement model is shown in Figure 1. The 
straight, arrows represent assumed causal' relationships among the latent, 
true scores (shoWn in ellipses) arid their manifest indicators. Curved, 
double-headed arrows represent correlations; the'correlations among 
response errors were added to the model during the analysis. For each 
latent variable, one manifest variable was set equal to the underlying 
factor plus an error term. In each case, this variable was the parental 

report of the respective status characteristic, and consequently gives to 

J . t , . 

the underlying factor the same scale of measurement as the' parent's 

P 

report. ' The two student's f-eports were set equal to a weighted functipn 
t>f the underlying factor plus an error, term. 

- - * 

Insert Figure 1 AbocvJ Here 



To test whether the within-variable, between-occasion error 
covariances, followed by the between-variable, within-occasion error 
covariances, provided a significant improvement in the fit of the model to 
the data, a hierarchical series of models was estimated. The strategy 
available for selecting the best-fitting model consists, first, of estimating, 
a constrained model (e.g., error covariances set at zero), and then 
estimating a less constrained model in which one or more formerly fixed 
parameters are set free. The statistical test consists of assessing the 
statistical significance of the im&jsotfement in fit going from the more 
constrained to the less constrained model. If the more constrained model 
fits the data, as well as the less constrained model within sampling error. 



limits, then one may conclude .that the constraints do not seriously erode 

the fit of the model. If the less constrained model yields a significantly 
* a 

better fit, then the less constrained modeTis probably to be preferred^ , 

RESULTS . 

Maximum-likelihood estimates of parameters implied by the. model 
shown in FTgure 1 were obtained by using LISREL (Joreskog and 
Sorbom, 1981). The steps followed in'the analysis .were dictated by the 
substantive questions. First, a model was estimated in 'which all error 
covariances were specified to be zero. Second, a model was estimated in 
which within-variable, between-occasion error covariances Were allowed to 
be free. Third, several possible between-variable, within-occasion error 

covariances were tested. for statistical significance. A 

■* ' * 

*Table 1 presents goodness-of-fit statistics for these several t 

*» 

models. Model A of Table 1 is a model with random errors in which all 
erro.r covariances were specified to be zero. The likelihood* ratio chi- 
square value for Model A wa* 85.70 with , 24 jdegrees of freedom, 
indicating that the mod^l as specified did not adequately reproduce the 
observed covariance matrix. • ■* 

----- 

Insert Table 1 About Here 



,l Model B is a modification oKthe initial model, Jn which three * 

within-variable, between-occasion error covariances were set free. K 
These error covariances .are between response errors of the student's 
reports of father's occupation, father's education, and mother's education , 

o - 9 
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in the 1980 base-year survey and the 1982 first follow-up survey. The 

^ ■ * , *■ 

difference in chi-squares between Model A and Model 6 is itself 

distributed as chi-squareL This differertce was .88 with 3 degrees of 

freedom. A value this small indicates that none of the three erro^ 

coyariances were statistically significant, a result confirmed by 

V 

examination of the parameter estimates themselves in relation to their 
standard errors. It is obvious that HSB respondents reported parental 
status characteristics with error, for the error variances were all 
statistically significant. These results suggest, however, that these 
response errors were not systematically related over time. Apparently 
the mistakes students made in reporting their parents' status ^ 
characteristics at one point in time ^ere unrelated to the errors they 
made in a subsequent survey. 

Although the within-variable, betweenToccasion errc^r covariances 
may be considered zero within sampling error limits^another possible ^ 
source of covariance among err^r terms exists. These are within- 
occasion, between -variable error covariances, and may exist because 
respondents within a given slirvey panel reported status variables with 
greater consistency than warranted in reality. Previous investigations 
have found such nonzero error covariances among education, variables . 
Bielby, et al. (1977) reported correlated errors between father's 
education and respondent's education, for blacks. *Mare and Mason (1980) 
reported correlated errors between mother's and father's education for 
sixth A and ninth graders. Wolfle and Robertshaw (1983) found correlated^ 
errors among reports of parental education for a sa^mple of 1972 high 
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school seniors, a result duplicated in Wolfle's, (1983) study ofx1980 higtl 
school seniors. And Hauser, et al. (1983) found such witjiin-oceasion 
correfated -response errors not only when' the respondents ^were high" 
school serliors but also when they were resurveyed, 18 ye"ars later. 

- To test whether the within'-occasion, between-variable error 
covariances among the students' ^reports of their parents 1 status were 
significantly different from zero, Modef'c was estimated. Model C 
included four error covariance terms to be estimated by LISREL: between 
father's occupation and father's education in the base-year and follow-up* 



survey?, and between father's education ^jid mother's education in both' 
surveys. The chirsquare value for Model C as shown in Table 1 was 
38.91 'with 20 degrees of freedom. The decrease in chi-square from that 
of Model A was 46.79 with 4 degrees of freedom. A value this large 
indicates that the error covariances are significantly different from zero-. 

An examination of the LISREL estimates for Model C indicated that 
only the error covariances for father's and mother's education were 
statistically significant. Apparently, when students reported their • 
father's occupation and education they did not report these with greater 
consistency than w&rranted by the association of the true scores for- 
these variables. Given these results, Model D was, estimated in which 
the error covariances for father's occupation and father's education, were 
set at zero. Comparing Model D to Model C'in Table 1 indicates that^ , 
these restrictions did not affect the fit of the model within sampling 
*error limits. ' *. . 



ii 



' V ' \ A ■ , ' " /' - 

A further examination" of the estimates in Model D revealed/chat one 

. V • ; x " : . . M . ■ < : V 

final change in the raodeltwas warranted, -r The modification indices in^ 

LiSREL indicate which fixed parameters in* ffie model, if set free, will 

provide ir^pr^v^ments in the^it of the model'-Jp the data. These 

* \v . ' * ' . v • , ' 

fndic&te^that tha ^rrror covarianoe between the parental reports of 

father s andinriothef s education - should be set free.. Accordingly, 

Model £ was, estimated in >which all thre^ b^tween-v^riabje, yvithin- 

occasion £rror covariances for father's and mother's education were 

'" - ■ ■ , J 

allowed tb be / ff^ee. 

*■ As. shown in Table 1, the chi-square value ftf)r Model ..'E* was. 28.-24 

with 21 degrees of freedom, a^d indicated that the model adequately fit 

the data and was an improvement over* that of ModelvD. All of the free 



estimaies in the model weri statistically, significant, and none of the ' 

modification indices indicated that any fi^ed parameter?, if set free, 

would significantly improve" the fit of the model to the data. .. ^ 

«'...• . * * 
% The parameter estimates for ModeL,E are shown in Table 2, and in 

standardized form in Rgure 1. These varues indicate, first, that 

parental educational attainment was reported more accurately than 

father's occupational ^status. This finding conflicts with Mare and Mason 

(1980) , who' found just the opposite, but agrees with the results of 

Wolfle and Ftobertshaw's ^1983) study of measurement error in 1972 high 

'school seniors' reports of parental status characteristics . Second, *the 

estimated shown in Table 2 indicate 1?i at th& reliability estimates for 

students are higher in value than those pf^parents, differences which 

are statistically significant! At first blusji this seems implausible. * We . 



are inclined to attribute this anomaly to'the' fact. that the students were 
responding to a written questionnaire while the parents were responding 



reporting and coding errors into the data. Finally, while the within- 



variafole, between-occasion error covariances have been found to be zero 
for these data, between-variable, within-occasion error covariances for 
father's and mother's education were found to be statistically significant. 
As shown in Figure 1, the correlations % among these error terms range 
from .14 to .20, indicating that both parents and students reported 
parental educational levels with greater consistency than warranted by 
the association of their true educational attainments. 



The process of educational and occupational achievement has 
become a major line of social science research. Lately , however, the 
findings in this line have been called into question because they may 
have depended on variables subject to large response errors (e.g., 
Bowles, 1972). Early applications of LISREL-type models that 
compensated for the effects of measurement error on structural parameter 
estimates indicated that the concern was unwarranted (Bielby, et al., 
1977). Subsequently, researchers became concerned that models which 
depended on dual reports of 'background characteristics overestimated the 
reliability of these variables by including correlated errors among 
estimates of reliable covariance (Broom, et al., 1978; Jencks, et al., 



to a telephone survey, which may have introduced additional sources of 
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1979). Using data from a' recent nationwide survey of high school 
sophomores in 1980, this study investigated the^ extent of these within- 
variable, between-oceasion ierror covariances. In short, we found no 
evidence to indicate the existence of such error covariances in the 
reports of high school sophomores resurveyed two years later. Like 
previous studres in this area, our data yield estimates of reliability that 
are in the range of .7 to .9 for students' reports of parental status 
characteristics. Giyen the findings presented here, we do r>ot believe 
further concern is warranted about whether these reliability estimates are 
artificially inflated by correlated errors. 

The presence 6f between-variable, within-occgsiorK error' 
covariances is another matter. Massagli and Hauser (1983) noted in their 
review of a number of studies that "none of the sjttfdies has provided 
substantial evidence of nonrandom measurement error." lur findings 
.indicate that models which include measures of father's occupational 
status and father's education are generally free of nonrandom error. 
Nevertheless, we have found evidence that when respondents are asked 
to report both parents' educational attainment they do so with correlated 
errors of measurement. Our conjecture is that respondents reconcile 
uncertainty about one parent's educational attainment by making 
reference to perceptions of the other parent's education. The 
significance of these correlated response errors notwithstanding, their 
influence on the estimated correlation between father's and mother's true 
educations is modest; with correlated response errors (Model E) the 
estimated correlation was .621; without correlated response errors (Model 
A) the estimated correlation was .627. 



14 



In conclusion, we find little evidence to support the claim that 
reliability estimates for social background variables are inflated due to 
correlated errors of measurement. We tested for such correlated errors 
among reports .of father's occupational status, father's education, and 
mother's education-, and found. none. We did find,, however, that when 
respondents are asked to report parental educational attainments, they 
tend to do so with greater consistency across parental reports than 
warranted by the trge association of parents' education. Given these- < 
findings, coupled with the presence of simple unreliability, we are led 
more than ever to prefer analyses of educational and occupational 
achievement based on models with well-defined measurement $nd error 
structures. 
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^ *. FOOTNOTES* 



1. The exact questions used in the original survey are available 
in the data file user's manual (National Opinion Research Center, 1983), 
but #re summarized here. 6f the variables included in this analysis, the' 
HSB sophomores were first asked to categorize the, job most recently held 
by their father. They were asked to choose one of seventeen categories 
(clerical, craftsmen, farmer, etc.); these responses were then recoded to 
their equivalent Duncan (196+) socioeconomic index scores as given in 
Levinsohn, et'al. (1978, Appendix O, p. 11). The sophomores were 
next asked to indicate the highest level of education completed by their 
father. A similar question was asked about their mother's education. . * 
These responses were then recoded to match the categories used in the 
' parent's survey; the resulting scales ranged from 1 to 8, representing 
categories from less .than high school (=1) to the receipt of a Ph.D.,; 
M.D., or other advanced degree (=8). • 

After the collection of base-year data from the hi^h school \ ' 
.students, 3367-parents of the HSB sophomores were contacted apd 
additional data collected, which concentrated primarily- on the parents' 
plans for financing their children's higher education. Included in the 
questionnaire, however, were questions dealing with parent'al 
socioeconomic characteristics. In about 60 percent. of the cases, it was 
the'student's mother who completed the questionnaire, while the 
student's father completed the questionnaire in the remaining cases 
(students who had some other adult complete the questionnaire, such as 
an aunt or grandfather, were excluded from these analyses). Parents 
completing the questionnaire were asked to report their occupation, their 
.spouse's occupation, their education, and their spouse's education. 
These were recoded as appropriate to obtain a report ofithe father's 
education (as reported either by himself or his spouse); and mother's 
education. These were recoded to match equivalently the scale used by 
students to report their parents' education. The occupation question 
used in the parent's survey was coded according to the U.S. Census 
Bureau's detailed occupation code. In order to match these responses 
with those of the high school sophomores, the detailed occupation codes 
were collapsed into the identical categories used by the students, and -. 
assigned the same Duncan (1961) SEI scores. 

In 1982, the HSB sophomore cohort, now high school seniors, was 
resurveyed. They were once again asked to report their parents' 
statuses, and their responses were treated exactly as described above 
for the base-year data. \ 

The correlations among these nine variables, plus their means and 
standard deviations, are shown in Appendix Table A. 
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Table If Goodness-of-Fit , Statistics for ^Measurement Models of Parental 
- - Status Characteristics, White High School Sophomores^ in 1980 

(N = 1064 listwise present) 





Model 


L 2 


d.f. 


Prob . 


L 2 /d.f. 


A. 


No error covariances 


85.70 ' 


24 I 


.000 


3,57 ' 


B. 


Within-variable, between- 
occ^as ion/error covariances 
B vs. A 


84:82 
.88 


, ?1 
3 


.000 
.830 


4.04 
.29 


C. 


Between-var iab le , within - 
occasion error covariances 
for students 1 reports of 
parental status 

•c vs. a; - cr 


38.91 
46.79 


20 
'4 


007 * 
. .000. 


1>95 
11.70 


D.- 


Between-var iab.le, within - 
occasion error covariances 
for students 1 reports of 
parental education 
C vs. D 


39.08 
.17 


22 
2 


1 

.014 
.918 


1.78 ' 
. 08 


E. 


Between-var iab le , within - 
occasion error, covariances 
for parents 1 and students 1 
reports of parental 
education 
E vs. D 


28. .24 
10.84 


21 
1 


.133 
.001 


1.34 
10.84 
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Table 2. Model E Parameter Estimates 
(standard errors .in parentheses )> 



Latent 


Manifest 


Lambda 


Error 




Characteristic 


Report ■ ; 


Coefficients , 


Variance 


Reliability 


r atner s 


Parent 


1.00* 




179 Ofi (Q QfH 


.66 


Occupation 


Stud. 1 


1.017 


(.034) 


144.23 (9.03) 


.71 




Stud. 2 • 


1.026 


(.033) 


118.64 (8.27) 


.75 


Father's 


Parent 


-1.00* 




.552 (.032) • 


.88 " 


Education 


Stud. 1 


1.061 


(.016) 


" .421 (.030) 


.92 




Stud. 2 


1.062 


(.015), 


.380 (.029) 


.93 


Mother's 


Parent 


1 . 00* 




.404 (.025) 


.86 


Education 


Stud. 1 


1.080 


C.019) 


.419 (.027) 


.88 




Stud. 2 


1.097 


(.018) 


.•301 (.025)- 


.9a 



e 

True Score Covariances 



1. Father's Occup. 

2. Father's Educ. 

3. Mother's Educ. 



1. 

334.71 (21.67) 
27.45 (1.64) 
13.44 (1.11) 



2. 

4.23 (.21) 
2.05 (.13) 



2.59 (.13) 



Error Covariances 

1. Fath. Educ. Parent and Moth. Educ. Parent 

2. Fath. Edud. Stud. 1 and Moth. Educ. Stud. 1 

3. Fath. Educ. Stud. 2 and Moth. Educ. Stud. 2 



.064 (.020) 
.066 (.020) 
.068 (.018) 



✓*Fixed value. 



Table A. Correlations, Means, and Standard Deviations Among Variables in Measurement Model 
of Parental Status Characteristics, White High Schoo I -Sophomores in 1980 - 
» (i\ = 1064 listwise present) . • ' t 



Respondent Variable 


1 


2. 


3 


4 


5 


6 




7 


8 


9 


1. Parent 


Fa.Occ. 


1.00 
















• 




2. Stud. 1 


Fa.Occ. 


.675 


1 .00 




* 














3. Stud. 2 


Fa.Occ. 


.710 


.726' 


1.00 


* 














i\. Parent 


Fa.Educ. 


S67 


- RQ7 


592 


1 .00 














5. Stud. 1 


Fa. Educ. 


.565 


.597 


.590 


.901 


I.QO 










1 


6. Stud. 2 


Fa. Educ. 


.565 


" .600 


.597 


.905 


.923 






\ 






7. Parent 


Ma . Educ. 


.371 


.395 


.365 


.559 


.561 


.553 


1. 


,00 






8. Stud. 1 


Ma. Educ. 


.356 


.383 


.334" 


.554 


.586 


:564 




.870 


1.00 




9. Stud. 2 


Ma. Educ. 


' .348 


.386 


.342 


.546 


.569 


.576 




,888 


.895 


K00 


Means 




45.94 


43.56 


45.48 


3.744 


3.644" 


3.659 


3 


.128 


3.156 


3.189 


Standard 


Dev. 


22.51 


22.15 


. 21 .71' 


2.187 


2.279 


2.266 


1 


.729 


1.856 


1 . 846 



ERIC 
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